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TWO-LIMIT PROBLEMS FOR ALMOST SEMICONTINUOUS 
PROCESSES DEFINED ON A MARKOV CHAIN 

levgen Karnaukh UDC 519.21 

We consider almost upper semi-continuous processes defined on a finite Markov chain. The distribu- 
tions of the functionals associated with the exit from a finite interval are studied. We also consider 
some modification of these processes. 

ON ' 

. Problems related to the exit of a process with independent increments from an interval were in- 

' vestigated in many works (see, e.g. [1], [2]). Analogous problems were investigated for processes on 

, a finite Markov chain under the semicontinuity condition [3, 4]. For walks on a countable Markov 

^ i' chain, a two-dimensional problem was studied in [5]. In the present paper, we consider distributions 

D . of some functionals associated with the exit from a bounded interval for a process with independent 

' increments on a finite Markov chain under the assumption that this process crosses a positive level only 

00 ' by exponentially distributed jumps (an almost semicontinuous process [6]). 

The distributions of overjump functionals described by integral equations on a semi-axes are defined 
by the projection factorization method using an infinitely divisible factorization (instead of canonical 
factorization). In the present paper, we investigate functionals described by integral equations on an 
interval that can be extended to a semi-axes. In the solution of the extended equation, we use the 
' method developed by Krein in [7, 8] and probability factorization identities. 

, Consider a two-dimensional Markov process: 

z{t)^{at),x{t)}, t>o, 

where x{t) is a finite irreducible nonpcriodic Markov chain with the set of states E' = {1 . . . m} and the 
I matrix of transition probabilities 

CN . P(i) e*'5, t > 0, Q = N(P-I), 

■ 

where N ~ \ \Skr t^A;||™r=ii ^^'^ parameters of exponentially distributed random variables (the 

On ' sojourn time of x{t) in the state fc), P = \\Pkr\\ is the matrix of transition probabilities of the imbedded 

I chain; tt = (tti, . . . , TTm) is the stationary distribution, and ^(t) is a process with stationary conditionally 

Q!^ ■ independent increments for fixed values of x{t) (see [3, p. 13]). 

^""^ ' The evolution of the process Z{t) is described by the matrix characteristic function: 

*,(a) = ||E[e*"«W,x(i) =r/.T(0) = fc]|| =Ee*"«(*) = e**("), *(0) = Q. 
In what follows, we consider processes that have cumulant 

*(a) = AFo(O) (C (C - laiy^ ~ + / (^'"" " 1) ^Koix) + Q, (1) 

J —oo 

where 

dKo(x) = NdF(a;) +n(dx), F(x) - \\P{xkr <x;x{Ci) = r/x{0) = fc}||, 
Xkr are the jumps of ^(t) at the time of transition of x{t) from the state k to the state r, 

U{dx) = AdFoix), Fo(.t) = \\6krF^{x)l 
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Fj^{x) arc the distribution functions of the jumps of ^{t) if x{t) = fc, A = ||(5fcrAfc ||, A^- arc the parameters 
of exponentiaUy distributed random variables (the time interval between two neighboring jumps of 
^{t) if x{t) = fc), C = ||(5A:rCfc||, and c^. are the parameters of exponentially distributed positive jumps 
of ^(t) if x{t) = k. The process Z{t) with this cumulant is the almost upper-semicontinuous process 
defined in [6, p. 43]. 

Let 6s denote an exponentially distributed random variable with parameter s > {P{Os > t} = 
e~**,t > 0), independent of Z{t). In this case, we rewrite the characteristic function of ^(^s) as follows 

/>oo 

*(s, a) = Ee*"«(''^) s / e-"*$t(a)dt = s {si - , 
Jo 

''p{t)dt = #(s, 0) = s{si- qy^ . 

Denote the time of the first hit of a positive (negative) level by 

T+{x) = inf{i > : £_{t) > x},x> 0, 

{t- {x) = inf > : £_{t) <x},x <0) 
and the time of the first exit from the interval {x — T,x),0<x<T,T>0 by: 

t(x, T) = inf {t>0: ^{t) (^{x-T, x)} . 

We introduce the events 

A+{x)^{Lo:arix,T))>x}, A_{x) = {lu : arix,T)) < x ~ T} . 
Then, for a; > 0, we can write: 

^ '+ix,T) = T+{x), LueA+ix); 



Tix,T) = 



T- {x, T) =T-{x~T), uj eA^ (x). 



Denote the overjumps at the time of exit from the interval by: 

j^{x) =x-T- C(r-(x-, T)), j+{x) ^ C(r+(x-, T)) - x. 

In the first part of the paper, we obtain closed-form representation of the following moment generating 
functions: 



B^{s,x) 



BTis,x) 



E 



E 



E 



E 



^-sr(x,T)^ ^(t(x, T)) > X, x{t{x, T)) = r/x{0) = k 
^~sr(x,T)^ e(T(a;, T))<x~ T, x(r(x, T)) = r/x{0) = k 



B(s,a;,T) = Ee~"^(^''^\ V(s, a, a;, T) = E [e*"«(^=\ r(x, T) > 



V±(s,a,a;,T) =E ^"7^ W-.sr±(a.,T)^ ^^^^^ 
V±(s,a,x,T) =E [e*"«(-±(-.T))— ±(.,T)^ ^^^^^ 

Denote the set of bounded functions absolutely integrable on the interval / C {—oo, oo) and the set 
of their integral transforms by 



/:„(/)= G(x) = \\Gkr{x) 



\Gkrix)\dx < oo; fc, r = 1, m > , 
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= |g''(a) = \\glia)\\ : ^^(a) = C,, + J^e^'^^G,r{x)dx;k,r = l,m 

We introduce the projection operation onto cxo, c>o)) 

[C + g(a)], = J e"'''G{x)dx, [C + g(a)]° = C + J e"'^G{x)dx, 
[C + g(a)]_ = [C + g(a)](_^,o) , [C + g(a)]+ = [C + gia)]f^o.,oo) ■ 

Note that V{s,a,x,T) e «HO^((a; - T, x)), V+(s,a,2;,T) e fR^„ ([a;, oo)). V-(s,a,a;,T) G fR^^((-cx), a; - 

Further, we introduce extrema of ^{t) and the corresponding distribution functions 

^±(0 = sup (inf)^(u), e = sup (inf)^(w), 

Q<u<t 0<u<oc 

P+(s, x) = P <x},x>0, P-(S, a;) = P {^(0,) < a;} , a; < 0, 

p+is) = P = 0} , q+(s) = P, - p+(,s), 

p;(,s) = p+(s)p,7\ r;(s) = cp;(s). 

Lemma 1. [3, p. 49] For f/ie two-dimensional Markov process Z{t) = {^(t),x{t)}, the following factor- 
ization identity is true 



[*„(s,q;)Ps * (s,a), 



(2) 



where 

Theorem 1. For a process Z{t) with cumulant (1), B"^(s,a;) is determined by the relation 
sB^(s,x) =s(l-p;(,s))e-^+(^)--p;(s) r ^ dP-{s,y)e-^^^-y^C^{s)- 

•J —oo 

-(l-p;(s)) re-^;(^)-R;(,s) r ' '^dP-(s,2/)e-c(--«--)cizC^(s), < x < T, (3) 

JQ J -oo 

C^(s) = AFo(O) (^I + C ^ e*^"B^(s, j . 
Proof. Using the stochastic relations for t^^{x,T), namely, 



+ (a:,r) = <^CL+r+(x-a,T), < Ck,x - T < < x, (4) 



fcrV-^> ^ / - \^k^ 'kr 



Ck + T+{x - Xk3,T), C'k> Ck,X - T < Xkj < X, 



where the subscripts denote, respectively, the initial state and the state of the chain x{t) at the time of 
exit form {x — T, x) (x(0) = fc, x{t{x, T)) = r), we get 

Bl{s, x)^Xkj^ er^^+'>'+'^''^ydyi^J dF^{z) + j ^dF^{z)Bl{s, x ~ z)j + 
+ y,^k e-^'+^'+'^'^ydy / dFk,{z)Bj^{s, x-z),0<x<T. 

„_i Jo Jx-T 
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We can rewrite these equations in the matrix from: 

(sI + A + N)B'^(s,a;) = AFo(2:)+ / dKo{z)B'^{s,x - z), < x < T, (5) 

Jx-T 



-T 

B'^(s,x) 0, x > T, B'^(s,a;) = I, a; < 0. 

Performing the substitution B"^(s,x) = I — B^(s,x), in (5), we derive the following equation for 
B ^(s,a;) (0 < a; < T) 

/OO 
dKo(z)B^(s,a;-z), < a; < T. 
-OO 

Extending this equation to the semi- axis x > 0, we obtain 

/OO 
dKo(z)B ^(s, x-z) + e-*^^C^(s)/ {x > T) . (6) 
-OO 

We denote Ce{x) = e~^^/{x > 0} and consider the foUowing equation for Ye(T, (.t > 0,e > 0), 
instead of Eq. (6): 

/OO 
dKo(z)Fe('r, s, X - z) + e-^^C^{s)I {x > T} , (7) 
-OO 

Applying the integral transform with respect to x to (7), wc get 

(si- *(a))Ye(T,s,a) =(sl- Q) / e"^e-"dz + / e''^'^ e-^'-C^ {s)I {z > T} dz- 

Jo Jo 

- Ko(a)Y,(r,s,a)]_, 

POO roc 

Ko{a)= e^"^dKo(z), Y,(T,s,a) = / e*"^Y,(T, s, z)dz. 
Using (2) and (8) and performing the projection [] , , we obtain 



(8) 



sY,(T,s,a) = *+(s,a)P7^ 



*-(s,a)(^(sI-Q)^ e"''e-''dz+ 

+ e^""e-^"Cj(s)/ {z > T} dz^ 



Inverting this relation, we get 



sY,{T,s,x)^[ dP+{s,z)P;' f dP-(s,y)(sI-Q)e- 

Jo J -OO 

px pm\n{x — z — T,0} 

+ / rfP+(s,z)P;i / dP-(s,y)e-^(--^-^)CJ(s), 

Jo J -OO 



(9) 



Since Ye(T, s, x) ^ B (s, x) as e ^ 0, < x < T, relation (9) yields 

/•a: px px — z—T 

sB^{s,x)= dP+{s,z){sI-Q)+ dP+{s,z)p-^ dP-{s,y)e-^^^-y-'^C'^{s). 

Jo Jo J -OO 

Taking into account that [6, p. 45] 

P {eiOs) > ^} = (I - P;(s)) e-^+(^)-P„ X > 0, (10) 

we get (3). 

Below, we present (without proof) analogs of the Pecherskii identities (see [2, p. 108]). 



Lemma 2. The following identities are true for Zit) 

Y{s,a,x,T) = *(s,a)(I- V+(s,a,x,T) - V_(s, a, a;, T)) , (11) 
V{s, a, X, T) = a)P;i (s, a)(I - V+ (s, a, x, T))] , (12) 

V(s, a, X, T) ^ *_(s, «)P;i a){l - V_(s, a, x, T))] . (13) 

Denote the joint distribution of {S,{0 s) , i'^ {0 s) , i~ {0 s)} by 

H,(r,x,y) - ||P{e(0.) < y,e+(f?..) < x,C{0.) >x-T, x{e,)^r/x{0) = fc}|| 
= PU(0.) <2/,r(x,T) >0J. 

Theorem 2. For a process Z{t) with cumulant (1), the joint distributions of •{r+(a;, T), 7^(2;)} and 
{r+(2;, T), ^(t'''(x', r))} are defined by the relations 

jY+{s,a,x,T) = B^(s,a;)C(C -ml)"^ , < x < T, 

|v+(s,a,x,T) = e'"^^V+(s,a,a;,T). ^ ^ 

The characteristic function of ^{9s) up to the time of exit from the interval has the following form 

V(s,a,a;,T) = *+(s,a)P;i [*~(s,a) (l-e*"^B^(s,x)C(C -ml)"^)l . (15) 

L V /J [x — T,oo) 

The corresponding distribution has density {x — T < y < x, y ^ 0) 
d 

hs(T,x, y) = —'H.s{T,x,y) = 
dy 

r'inin{0.y} 



= p;(s)(p-(s,2/))7{y<o} + (i-p;(s)) / e-^+(^)(^-^)R;(s)dp-(s,z) 

J x-T 

-p;(s) r dP-{s,z)-B^{s,x)Ce-^^y-^-'^ -{l-v*+{s)) C ^^-^+(^)"x 
J -00 Jo 

/y — v — x 
R;(s)dP-(s,z)B'^(s,x)Ce-<^('^""-^-^)dv, (16) 
-00 

with atom at zero 

P {e(0.) = 0, t{x, T)>B,}=s{sl + K-N (IIP {xfc. = 0, x(Ci) = r/x(0) = k}\\ (17) 
T/ie probability of nonexit from the interval [x — T, x) is determined by the relation 

P {t(x, T) > 0J = / dH,(r, X, y). (18) 

For the moment generating functions of t{x^T) and t~ (x,T) , the following relations are true: 



B{s,x,T) = I-P {t{x,T) > 0,}p-\ 0<x <T, 
Bt(s, x) = B(s, X, T) - B^(s, x), 0<x <T. 



(19) 



Proof. Using stochastic relations (4) for t'^{x,T) and 



Cfe, Ck<Ck,^k>x, 

7+(a;)fcr = { J^^ix - e,k)kr, Ck < Ck,x - T < £_k < X, 
,7^ (2^ - Xkj)jr, Ck > Ck,x - T < Xkj < X, 



we obtain the following equation for '-f^{x): 

{sl + N + A)Y+{s,a,x,T) = AFo(0)e"*^"^C (C - ial)"^ + [ dKo(z)V+(s, a, a; - z,T). 

Jx-T 

Using (5), wc deduce the first relation in (14). The second relation follows from the definition of 7^(0;). 
Relation (15) follows from (12). After the inversion with respect to a, we obtain (16) and (17) from (15). 

Using relations (16), (17) and an analog of the Bratiichuk formulas [1, p. 187], we can obtain a matrix 
analog for the generatrices of the joint distributions of {t^{x, T), <^(t+(.t, T))} and {r^ {x, T), <^(t~ {x,T))}: 



Theorem 3. For Z{t), the following relations are true: 



sE 



sE 



e— "(-^^),e(T+(a;,r))> 
-"""("'^),e(T-(x,T)) < z, 
Ko(a^) = 

Proof. According to [4, p. 469], we have 



dHs(T, X, y)Vio{z -y), z> x, 



x-T 

dKo{y),x>0, Ko{x) 



dHs(T, X, y)Ko{z -y), z <x-T, 
dKQ{y),x < 0. 



(20) 
(21) 



E,; 



e— (-.^)/(a; - ^(r(x, T)), x(t(z, T)))] ~ /(x, z) = E 



-ix.T) 



e-''g{x-m,^{t))dt, (22) 



where / is a bounded function, g = Af — sf and A is a generator of the semigroup defined by the 
cumulant '4' (a). For the right-hand side of the equation, we have 



E,; 



t{x,T) 



3 = 1 



gix~m.xit))dt^J2 e~'''^^[9ix - m,j),r{x,T) > t,xit) = j]dt 



m „x 

E'^"' / 9{^-y,j)d{H,{T,x,y))^^. (23) 



Assuming that f{x, i) = I{x > —z}6ir, 2: > 0, z, r G E' , we obtain 



E,; 



,-^rix,T)j^^ _ ^(^(^^ T)), x(r(x, r)))l - fix, z) 



E,: 



'e-^^(-'T\j+ix) > z, x{t{x, T)) = r] , (24) 



gix,j)= / I {x - y < -zjdK^Q^'iy) ^ K-'J{x + z) 
J —00 

Substituting (24) and (25) into (22) and taking (23) into account, we get 

~st{x,T) 



E,; 



e -■'•■^'^\-f:j:{x)>z,x{T{x,T))=r\=^s W K^^ {x - y + z)d{Hs{T,x,y))^ 



(25) 



(26) 



x-T 



Using the definition of 7^(0;), we derive (20) from (26). By analogy, we obtain relation (21). 
Consider the behavior of the functions B^(s, x) and Hs(T, x, y) as s ^ 0. Denote 

M(y) = lims-ip;(s)p-(s,2/). 
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The existence of this function follows from the reasoning presented below. According to [6, p. 46], for 
the moment generating fmrction of ^{9s) we have 

lim .s-ip;(.s)Ee''«(''-) = - (p;(0)C - rl) (C - riy^ ^-^(-ir). 
Then we can define M.{y) as a function for which 

/ e'"ydM(y) = - (p;(0)C - rl) (C - riy^ *"^(-ir). 

J — OO 

Furthermore, it follows from [6, p. 41] that 

p;(0) = (I - ||P{r+(0) < oo,x(r+(0)) = r/x{0) = k}\\) . 
Corollary 1. For the process Z{t) following relations are true: 



lims-ih,(r,a;,y)==M'(y)/{2/<0} + (l-p;(0)) / e-^+(°)(^^^)CrfM(z)- 
-(l-p;(0)) r ' ^-^+(o)"C r dM(z)B^(:E)Ce-^(^-"-"-"^ 

Jo J -OO 



r dM(z)B^(a;)Ce-'='(^-^-^\ (27) 

J —OO 



B^(x) ^ lim B^(s, x)^{I- p;(0)) e-^+(")" - / dM(y)e-^("-^'C^(0)- 

-(l-p;(0)) Te-^+^o^^C r ' ^dM(y)e-^("-^-")dzC;^(0), (28) 

Jo J-oo 

Cj(0) = AFo(O) (l + C e^^B^(z)dz j . 



Assume that Xkr = 0. If x(t) = fc, fc = 1, m, then we set 



where i^fc(i) and z/fc(t) are Poisson processes with the rates and A^, respectively. ^^'^ and are 
independent positive random variables, are exponentially distributed with the parameters Cfe, the 
variables have an arbitrary distribution with bounded expectation m^. It is clear that, in this case, 
the process Z{t) ~ {^(t),a;(t)} is the almost upper-semicontinuous and has cumulant 

*(a) = AFo(O) (C (C - laiy^ ^^)+ f ^"^'""^ ~ ^) + 

J —OO 

where 

A = ||4r(Ai. + Fo(0) = \\5kAl/{Xl + Tl{dx) = AFo(0)dFi(x), 
Fo(0) = I - Fo(0), ¥l{x) = II4.P {-e' < x} II, X < 0. 
Consider the process rjB,u{t) defined by the stochastic relations 

VB,uit) t& {Ti,T2), Ti < OO, (29) 
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where the superscripts kr mean that x{t) = r,x{Q) ~ k. Note that. Ti = t+(u), v = B — u and 
r2 = Ti + (^H., C» is the time of the first negative jump independent of Ti. 

The process rjB,u{t) is called the risk process in a Markov environment with stochastic premium 
function and bounded reserve(see [9] - [11]). We also consider the dividend process YB,u{t) = u + C(^) ^ 
r]BAt) (sec [9, p.169]). 

Theorem 4. The distribution of riB,u{Os) is determined by the characteristic Junction 
*B,«(s, a) = Ee*""«'"(''^^) = e''"-^ ((C - ial) p;(s)e-*""- 



I - p;(.s)) e-^+(^)''R;(s)) (R;(s) - lal) ' *"(s, a)+ 

(I - p;(s)) e-n(-)" (,sl + AFo(O) - Q)-i (se'"^ + AFo(0)*b(s, a)) , (30) 



*B(s,a)= / dFj(z)*B.B+,(s,a)=e^"^(AFo(0))-'(sI + AFo(0)-Q)(p;(s)) x 

J — OO 

X (si + A - Q)-i f U{dz)({l - p;(s)) e^+(^)"s (si + AFo(O) - Q)"' + 

J —OO \ 

+ (e'"" (C - lal) - (I - p;(s)) e^+(")"c) p;(s) (R;(s) - ml)"' ^-{s, a)^ . (31) 
If mi = X^fcLi 7rA:(A^/cfe — A^mfe) > 0, then the following relations hold for i]b.u = linig^o VB.ui^s) 

$B,„(a) = Ee'""^'" = e^"^ (l - p;(0)) e-^+^o^^p; (A - Q)"^ / Il{dz)x 

J — OO 

x(_e'"-*-i(a) + (I - p;(0)) e^+("'^((AFo(0) - Q)"V C (C - laiy^ *"'(«))) , (32) 

P {riB,u =B] = {1- p;(0)) e-^^W'^p; (A - Q)-^ x 

X / n(dz)(l-p;(0))e^+WMAFo(0)-Q)-\ (33) 

J — OO 

For the dividend process Yb.u{^s), the following relations are true: 

^^-^Yn.AOs) = (l - (I - p;(s)) e-^+(^)> (mI + R;(s)) P„ (34) 
P {YB,um = 0} = P {e{ds) < v} = P, - (I - p;(s)) e-^^^^^^P,. (35) 

Proof. It follows from (29) that the characteristic function of 7]B,u{t) satisfies an integral relation, 
which, after the Laplace-Karson transform, takes form 

*B,.(s,a) = e'""E [e'"«(''^),^+(0,) <v\ + 

+ e^«-^E [e-'^\Ti < oo] (I - Ee-'*^*) P, + E [e-"'^\ Ti < oo] Ee-"^**B(s, a). (36) 

According to [3, p. 50] and [6, p. 43], we get 

E[e-^^Sri < oo] = (l-p;(s))e-^+(^)", 
Ee-<' = (si + AFo(O) - Q)"' AFo(O), (37) 

(c - *ai)p;(s) - (I - p;(s)) e(»i-^;(^))''R;(s)) (r;(s) - mi)-'*-(s,«). 
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Substituting these formulas into (36), wc obtain (30) and the relation 
^B{s,a) = e'"^ (l - f dFj(z) (I - p;(s)) e^+f^)-' x 

\ J —oo 

X (si + AFo(O) - Q)"' AFo(O)) (^j e'""drj(z) (C - ial) - 
- f dFi(z)(l-p;(,s))e^;(^)^c)p;(,s)(R;(,s)-*al)-'*-(,s,a) + 

J —oo / 

+ /" dFi(z) (I - p;(s)) e^+(^)^s (si + AFo(O) - Q)"^) . (38) 

J — OO / 

The stochastic relations for t^{x) (see [3, p. 62]) yield the following equation for p!^(s): 

(si + A - Q) (I - p;(s)) = AFo(O) + AFo(O) T <m\{z) (l - p;(s)) e^P+(^)^ (39) 

J —oo 

Substituting (39) into (38), we receive (31). Note that, for > 0: has a degenerate dis- 
tribution. Therefore, the first term in relation (36) tends to as s ^ 0. Since (I — Ee"*""*) — 
s (si + AFo(O) — Q)~^ Pj^, the second term in (36) tends to too. For the third term, by virtue 
of Theorem 3 in [6] and the first relation in (2) wc get 

Inns (p;(s))"^ = P% 
lims-ip;(s) (R;(s)-ml)"^*"(s,a) = lmi(C - ml)"! (si - *(a))"^ = 

Thus, passing to the limit as s ^ in (36) we obtain (32). Relation (34) and (35) follow from the 
representation: Yb^J^) = max (0,^^^{t) — v) . 
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